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Title of the Invention 
Asynchronous Out-Of-Band Delivery of Embedded Media Objects 
BACKGROUND OF THE INVENTION 

6 

7 Field of the Invention 

8 

9 This invention relates to delivery of embedded media objects. 
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1 Related Art 

2 

3 In computer communication networks, one method of communication is 

4 email ("electronic mail"), in which a sending user prepares and sends a message to a re- 

5 ceiving user. Email is well suited to relatively short messages, such as text. However, 

6 when the sending user wishes to send a relatively larger amount of information, such as a 

7 media document (one example of a media document is a video clip), known email sys- 

8 terns are subject to several drawbacks. 
CI 

M A first drawback of known email systems is that a media document can be 

m\ 

m larger than the maximum size of messages for which the email system is designed. For 

,p example, some known email systems are unable to deliver messages longer than about 

r ft 500 kilobytes in size, while many media documents can be several megabytes in size. 

Sli 

{ft 

m A second drawback of known email systems is that a relatively large media 

16 document can take a correspondingly large amount of time (and other resources) to de- 

17 liver from the sending user to the receiving user. In known email systems, delivery and 

18 presentation of the media document to the receiving user is triggered by the receiving 

19 user's email client device. The receiving user might therefore be forced to wait a substan- 

20 tial time for the media document to be delivered and be available for presentation. 

21 Moreover, if a number of receiving users all attempt to access media documents at sub- 
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stantially the same time, an email server for those receiving users can become overloaded, 
thus degrading the receiving users' experience further. 

Accordingly it would be desirable to have a technique for delivery of em- 
bedded media objects, such as for example media documents, that is not subject to draw- 
backs of the known art. 

These advantages and others are provided in an embodiment of the inven- 
tion, described herein, including a technique in which media documents and other rela- 
tively larger documents can be delivered from a sender to a recipient and presented to the 
recipient with reduced use of time and other resources. 

SUMMARY OF THE INVENTION 

The invention provides a method and system for delivering relatively large 
documents (such as for example media documents) with reduced use of time and other 
resources. Relatively large documents sent by a sender to a recipient in an email message 
are delivered separately from the email message, asynchronously from delivery of the 
email message or its presentation to the recipient, and using an out-of-band technique 
separate from email message delivery. As shown below, this provides for relatively rapid 
and reliable delivery of the email message, separate reliable delivery of the media docu- 
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1 ment, and presentation of the media document to the recipient without further sending 

2 delay. 

3 

4 In a first aspect of the invention, a sender gateway is coupled to the sender. 

5 The sender gateway replaces the media document in the email message with a link, and 

6 caches that media document for delivery to the recipient using an out-of-band (non-email) 

7 technique, such as the FTP or HTTP protocols. The sender gateway delivers the media 

8 document to the recipient asynchronously from delivering the email message to the re- 
ft cipient, using one of several possible techniques: (1) scheduling delivery of the media 
jft document separately from delivery of the email message, (2) delivering the media docu- 
II ment in response to a separate request message from the recipient, or some combination 
Si thereof. 

% 4 

iff; [; 

!|f In a second aspect of the invention, a recipient gateway is coupled to the 

•iff " 

i§ recipient. The recipient gateway cooperates with the sender gateway in providing asyn- 

16 chronous, out-of-band delivery of the media document. In cooperation with the sender 

17 gateway, the recipient gateway can receive the media document using an out-of-band 

18 technique, such as the FTP or HTTP protocols, and reassociate that media document with 

19 the email message. In cooperation with the sender gateway, the recipient gateway can: 

20 (1) schedule receipt of the media document separately from receipt of the email message, 

21 (2) request delivery of the media document in response to the email message from the 
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sender, (3) cache the media document in anticipation of presenting that media document 
to the recipient, or some combination thereof. 

The invention has general applicability to sending and receiving relatively 
larger documents (including without limitation, media documents, attached documents, 
and the like) in association with relatively short messages (including without limitation 
email, "instant messaging," and the like). There is no particular limitation of the invention 
specifically to media documents or to email messages, nor is the invention necessarily 
related to the specific applications disclosed herein. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows a block diagram of a system for asynchronous out-of-band 
delivery of embedded media objects. 

Figure 2 shows a process flow diagram for asynchronous out-of-band deliv- 
ery of embedded media objects. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

The invention is described herein with regard to preferred steps and data 
structures. Those skilled in the art will recognize, after perusal of this application, that the 
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described steps and data structures are not limited to any particular circuits. Rather, those 
of ordinary skill in the art would be able to implement the described steps and data struc- 
tures, and equivalents thereof, without undue experimentation or further invention. All 
such implementations are within the scope and spirit of the invention. 

Related Applications 

Inventions described herein can be used in conjunction with inventions de- 
scribed in the following documents: 

U.S. Patent Application Serial No. 09/680,541, Express Mail Mailing No. EL 524 780 
772 US, filed October 4, 2000, in the name of Wei Yen et al., attorney docket number 
1 96. 1 00 1 .01 , titled "Replacement of Requested Data with Equivalent Data". 

U.S. Patent Application Serial No. 09/684,384, Express Mail Mailing No. EL 524 780 
582 US, filed October 4, 2000, in the name of Wei Yen et al., attorney docket number 
196.1002.01, titled "Adaptive Predictive Delivery of Information". 

U.S. Patent Application Serial No. 09/732,519, Express Mail Mailing No. EL 524 780 
335 US, filed December 6, 2000, in the name of Raymond Lo et al, attorney docket num- 
ber 196.1003.01, titled "A Trusted Gateway Device Serving Multiple Clients Providing 
Content Storage, Management and Delivery". 
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These documents are hereby incorporated by reference as if fully set forth 
herein. These documents are referred to as the "incorporated disclosures". 

Lexicography 

The following terms refer or relate to aspects of the invention as described 
below. The descriptions of general meanings of these terms are not intended to be limit- 
ing, only illustrative. 

out-of-band - In general, a technique or mode of operation different from that which is 
normally used. For example, where an email may normally be used to 
transfer data; data may be transferred using File Transfer Protocol (FTP). 
In this case FTP is an out-of-band technique. 

As noted above, these descriptions of general meanings of these terms are 
not intended to be limiting, only illustrative. Other and further applications of the inven- 
tion, including extensions of these terms and concepts, would be clear to those of ordinary 
skill in the art after perusing this application. These other and further applications are 
part of the scope and spirit of the invention, and would be clear to those of ordinary skill 
in the art, without further invention or undue experimentation. 
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1 System Elements 

2 

3 Figure 1 shows a block diagram of a system for asynchronous out-of-band 

4 delivery of embedded media objects. 

5 

6 A system 100 includes a sender 110, a sender gateway 120, a communica- 

7 tions network 130, a recipient gateway 140, a recipient 150, and an application service 

8 provider 160. 

51 

p The sender 110, includes a processor, program and data memory, mass stor- 

m 
%■ * 

m age, an input device, an interface device capable of coupling with a communications link 

15 1 15, and program software. The sender 1 10 preferably includes a personal computer or 

O 

i| similar device. The program software enables the sender 1 10 to perform the function of 

flj 

fft exchanging data with external devices. 


16 The communications link 115 operates to couple the sender 110 and all 

17 other devices either directly or indirectly to the communications network 130. 

18 

19 A sender gateway 120 includes a processor, program and data memory, 

20 mass storage, an interface device capable of coupling with the communications link 1 15, 

21 and program software. A gateway is a network point that acts as an entrance to another 

22 network. The sender gateway 120 operates to provide an entrance ("gateway") from the 
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network of the sender 110 to other networks, such as the network of the recipient 150. 
Gateways are known in the art. 

In a preferred embodiment, the sender 1 10 and the sender gateway 120 are 
separate devices, however, in alternative embodiments the sender 110 and the sender 
gateway 120 may be the same device. Moreover, in further alternative embodiments the 
sender 110 (and sender gateway 120, if any) can be the same device as the recipient 150 
(and recipient gateway 140, if any). 

A communications network 130 includes at least a portion of a communica- 
tion network, such as a LAN, a WAN, the Internet, an intranet, an extranet, a virtual pri- 
vate network, a virtual switched network, or some combination thereof. In a preferred 
embodiment, the communication network 130 includes a packet switched network such as 
the Internet, as well as (in addition to or instead of) the communication networks just 
noted, or any other set of communication networks that enable the elements described 
herein to perform the functions described herein. 

The recipient gateway 140, similar to the sender gateway 120, includes a 
processor, program and data memory, mass storage, an interface device capable of cou- 
pling with the communications link 115, and program software. The recipient gateway 
140 operates to provide an entrance ("gateway") from the network of the recipient 150 to 
other networks, such as the network of the sender 110. 
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1 As noted above, although the sender gateway 120 and the recipient gateway 

2 140 are shown as separate devices, there is no requirement that they are separate devices. 

3 In an alternative embodiment, the sender gateway 120 and the recipient gateway may be 

4 the same device. 

5 

6 The sender gateway 120 and the recipient gateway 140 are optional ele- 

7 ments of the system 100. In alternative embodiments, the system 100 may be configured 

8 with either the sender gateway 120, the recipient gateway 140, both or neither. In em- 
rQ bodiments where the sender gateway 120 is not present, the sender 110, the recipient 
# gateway 140, the ASP 160 or some combination may provide its functions. In embodi- 

ments where the recipient gateway 140 is not present, the recipient 150, the sender gate- 

|| way 120, the ASP 160 or some combination may provide its functions. 

m 

H 

3! The recipient 150 includes a processor, program and data memory, mass 

flj 

storage, an input device, an interface device capable of coupling with a communications 

16 link 115, and program software. The recipient 150 preferably includes a personal com- 

17 puter or similar device. The program software enables the recipient 1 10 to perform the 

18 function of exchanging data with external devices. 

19 

20 In a preferred embodiment, the recipient 150 and the recipient gateway 140 

21 are separate devices, however, in an alternative embodiment the recipient 150 and the re- 

22 cipient gateway 140 may be the same device. 
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1 An application service provider 160 includes a processor, program and data 

2 memory, mass storage, an interface device capable of coupling with the communications 

3 link 1 15, and program software. The application service provider (ASP) 160 operates to 

4 provide specialized applications remotely located to the user that would be expensive to 

5 install and maintain within their own company or on their own computer. Application 

6 Service Providers are known in the art. 

7 

8 In a preferred embodiment, a media object 111 includes an electronic data 

ff file in a media format such as MPEG2. Media objects are known in the art. An email 

# 112 includes electronic data in a file. Electronic mail (e-mail) is known in the art. 

1 

II System Operation 

m 

Jl! Figure 2 shows a process flow diagram for asynchronous out-of-band deliv- 

p ery of embedded media objects. 

16 

17 A method 200 is performed by the system 100. Although the method 200 is 

18 described serially, the steps of the method 200 can be performed by separate elements in 

19 conjunction or in parallel, whether asynchronously, in a pipelined manner, or otherwise. 

20 Similarly, although the method 200 is described as being performed by separate elements, 

21 these separate elements can be combined. Lastly, there is no particular requirement that 
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the method 200 be performed in the same order in which this description lists the steps, 
except where so indicated. 

At a flow point 210, the system 100 is ready to begin performing a method 

200. 

At a step 220, the sender 110 initiates an email 112 with a media object 111 
attached. The sender 110 composes an email 112 addressed to the recipient 150 and at- 
taches a media object 111 to the email 112. Generally, this is achieved using an email 
program such as Microsoft Outlook or Netscape Navigator. 

At a step 230, the sender gateway 120 replaces the media object 1 1 1 with a 
link (also known as a hypertext link) and caches the media object 111 at the sender gate- 
way 120 for delivery to the recipient 150 using an out-of-band (non-email) technique. In 
a preferred embodiment, delivery of the media object 1 1 1 is separate from the email 1 10 
using a protocol that can reliably transfer large files such as File Transfer Protocol (FTP) 
or Hypertext Transfer Protocol (HTTP). Generally, delivery of the media object 1 1 1 will 
be at a different time than the email 122 (asynchronous transmission), however it may oc- 
cur simultaneously. 

At a step 240, the email 112, excluding the media object 1 1 1 , is delivered to 
the recipient 150 through a normal electronic mail transfer. The recipient 150 does not 
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1 have to wait long from the time that the email 112 is sent. The email 112 is delivered 

2 quickly. Using the current state of the art, the recipient 150 would have to wait an ex- 

3 traordinary amount of time while the email 1 12 and the large attached media object 1 1 1 

4 are delivered together. 

5 

6 At a step 250, the media object 1 1 1 is delivered asynchronously from the 

7 email 1 12 to a location close to the recipient 150, such as the recipient gateway 140, the 

8 recipient 150 itself, or a relatively nearby caching server. This delivery may be triggered 
Q automatically by the sender 110, sender gateway 120, recipient gateway 140, recipient 

;ll 150, or ASP 160 depending on the elements present in the system 100 as detailed in the 

|N ? 

|| alternative embodiments herein. 

Si 

H When the recipient 150 chooses to view the media object 1 1 1, the object is 

M transferred from its relatively close cached location to the recipient 150. Since the cached 

y I? 

m location is functionally closer to the recipient 150 than the sender 110, and the network 

16 connecting the recipient 150 and the cached location can potentially be much higher 

17 speed, the final transfer of the media object 1 1 1 is relatively fast. 

18 

19 At a step 260 the email 1 12 has been delivered, and at the discretion of the 

20 recipient 150 the media object 1 1 1 and email 1 12 have been viewed. 

21 

22 At this step the method 200 has completed and may be repeated. 
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System Configurations 

The invention is flexible with regard to its implementation. In a preferred 
embodiment the system 100 includes all the elements illustrated in figure 1 except the 
ASP 160. As previously mentioned, the sender gateway 120 and the recipient gateway 
140 may also be optional. In alternative embodiments, the system 100 includes the core 
elements of a sender 110, media object 111, email 1 12, communications network 120, and 
recipient 150. In addition to these elements, an alternative embodiment may use any 
combination of the sender gateway 120, recipient gateway 140, and ASP 160. 

In a first alternative embodiment an ASP 160 is used. The email 112 and 
media object 1 1 1 are sent to the ASP 160. The ASP 160 strips the media object 1 1 1 from 
the email 112 and delivers the email to the recipient 150. The media object 1 1 1 is then 
delivered using an out-of-band transfer technique to a location relatively local to the re- 
cipient 150. This location may be a caching server in the network, the recipient gateway 
140, or the recipient 150. 

In a second alternative embodiment no sender gateway 120 or ASP 160 is 
used. The sender 110 initiates an email 112 with an attached media object 111. The 
email 112 is delivered through the standard e-mail delivery process with an embedded 
link to the media object 1 1 1 and the media object 1 1 1 is delivered out-of-band to a loca- 
tion close to the recipient 140. 
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In a third alternative embodiment the sender 110 or sender gateway 120 
may send a probing signal to one or both of the recipient 150 and ASP 160 to determine 
the best method of delivery. For example, the probe may determine whether there is an 
intermediate location where the media object 1 1 1 may be cached close to the recipient 
gateway 140, recipient 150, or ASP 160. The probe may also be used to detect the trans- 
fer protocol and media object 1 1 1 format preferred by the recipient 150. The sender 1 10 
or sender gateway 120 may then reformat the media object 111 and use the suggested 
protocol and route to deliver the media object 111. 

In a fourth alternative embodiment the recipient gateway 140 checks re- 
ceived email 1 12 automatically on a regular basis for any links to media objects 1 1 1 em- 
bedded in the email 1 12. Thus, it may pre-cache any links contained in the email 112. 

In a fifth alternative embodiment the sender gateway 140 separates the me- 
dia object 1 1 1 from the email 112, caches the media object 1 1 1 locally, and inserts a link 
into the email 1 12 through which the media object 1 1 1 may be accessed. This allows the 
recipient 150 or any intermediate device (such as, the recipient gateway 140 or ASP 160) 
to access the media object 1 1 1 on demand once the email 1 12 has been received. 
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Generality of the Invention 

The invention has general applicability to sending and receiving relatively 
large documents in association with relatively short messages. 
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